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Abstract 

Consider the minimization of the following quadratic functional 
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J{u)=E [ [(Q t X t ,Xt)dt + (N tUt ,ut)]dt + E(MX T ,X T ), 
Jo 



10 

where X is the strong solution to the linear state equation driven by a multidimen- 
| sional Browinan motion W and a Poisson random martingale measure jl(d9, dt) 

m 

d 

dX t = (AtX t + B t u t )dt + Y,( C t X t + D\u t )dWi 

i=l 



+ / (Et(p)X t - + F t (9)ut)ii(dB,dt), 
Jz 

^ X = X. 

Here u is a square integrable adapted control process. The problem is con- 
ventionally called the stochastic linear quadratic (LQ in short form) optimal con- 
trol problem. This paper is concerned the following general case: the coefficients 



A,B,C\D l ,E,F,Q,N and M are allowed to be predictable processes or random 
matrices. Associated with this LQ problem, the corresponding Riccati equation is a 
multidimensional backward stochastic differential equation driven by the Brownian 
motion W and the Poisson random martingale measure p,(d8,dt) (see (|5.9p ). The 
backward stochastic Riccati differential equation with jumps will be abbreviated as 
BSRDEJ. The generator of BSRDEJ is highly nonlinear in the the three unknown 
variables K, L and H (see (|5.9|) ). 

In the paper, we will establish the connections of the multidimensional BSRDEJ 
to the stochastic LQ problem and to the associated Hamilton systems. By the 
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connections, we show the optimal control have the state feedback representation. 
Moreover, we will show the existence and uniqueness result of the multidimensional 
BSRDEJ for the case where the generator is bounded linear dependence with respect 
to the unknown martingale term L and H. 

Keywords: Poisson random martingale measure, Linear quadratic optimal stochastic 
control, Random coefficients Dynamic programming, Ito-ventzeil formula, Riccati equa- 
tion, Backward stochastic differential equations, Stochastic Hamilton system 

1 Introduction 

Linear Quadratic (LQ in short form) optimal control problem is is a problem where 
the system dynamics are linear in state and control variables and the cost functional is 
quadratic in the two variables. It is well known that LQ problem is one of the most 
important classes of optimal control problem, and the solution of this problem has had a 
profound impact on many engineering applications and mathematical finance. 

The very first attempt in tracking deterministic LQ problem was made by Bellman, 
Glicksberg and Gross [2]in 1958. However, Kalman[TT] has been wildly credited for his 
pioneering work published in 1960, in solving the problem in a linear state feedback control 
form. Since then, the problem has been extensively studied and developed in major 
research field in control theory. Extension to stochastic LQ control was first carried out 
by Wonham (20] . Bismut [3J performed a detailed analysis for stochastic LQ control with 
random coefficients. With the joint effort of many researchers in the last 50 years, there 
has been an enormously rich theory on LQ control, deterministic and stochastic alike (see 

One of the elegant features of the LQ theory is that it is able to give in explicit 
forms the optimal state feedback control and the optimal cost value through the cele- 
brated Riccati equation. Associated with deterministic LQ problem or stochastic LQ 
problem with deterministic coefficients, the corresponding Riccati equation is backward 
deterministic ordinary differential equation. For the deterministic Riccati equation was 
essentially solved by Wonhan [20] by applying Bellman's principle of quasilinearizatin (see 
Bellmanp]) and a monotone convergence result of symmetric matrices. 

But associated with stochastic LQ problem with random coefficients, the correspond- 
ing Riccati equation is a highly nonlinear backward stochastic differential equations where 
the generator depends on the unknown variable in quadratic way. This sort of Riccati 
equation is called backward stochastic Riccati equation (BSRDE in short form). The 
interest of proving existence and uniqueness results for such a class of equations was first 
addressed by Bismut in [3]. It was clear from the beginning that to study those highly 
nonlinear backward stochastic differential equation (BSDE in short form) was already a 
challenging task and turned out to become a long-standing problem. The difficulty comes 
essentially from the fact that, in its general formulation, the BSRDE involves quadratic 
terms in both the unknowns (in particular in the so-called martingale term). Moreover 
the nonlinearity can be well denned only in a subset of the space of nonnegative matrices 
(where the equation naturally exists). 

For the special case that the generator of BSRDE depends on the unknowns martin- 
gale term only in linear way, Bismut [3] obtained the existence and uniqueness result by 
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constructing a contraction mapping and the using a fixed point theorem and in 1992, 
Peng[16j also gave a nice treatment on the proof of existence and uniqueness by using 
Bellman's linearization and a monotone convergence result of symmetric matrices-a gener- 
alization of Wonham's approach to the random situation. Later Kohlmann and Tang have 
made some progress towards solving the open problem. See [121 [13] and the references 
therein. However it is still far from the complete solution. Until 2003, by the methods 
of stochastic flows, Tang [18] solved the long standing open problem of the proof of the 
existence and uniqueness of the solution of the BSRDE in the general case corresponding 
to a linear quadratic problem with random coefficients and state-and control-dependent 
noise. In this work|18j. Tang provides a rigorous derivation between the Riccati equation 
and the stochastic Hamilton system as two different but equivalent tools for the stochastic 
LQ problem. 

For the discontinuous LQ problem, in 2003, Wu and Wang [21] discussed the stochastic 
LQ problem with the system driven by Brownian motion and Poisson jumps and obtain 
the existence and uniqueness result of a class of deterministic Riccati equation. And in 
2008, Hu and 0ksendal [9] studied the stochastic LQ problem for the one- dimensional case 
with Poisson jumps and random coefficients under partial information, and the main result 
is to show the optimal control has state feedback representation by an one-dimensional 
BSRDE with jumps in view of the technique of completing squares. But in [9], the author 
did not discussed the existence and uniqueness of the solution to BSRDE with jumps. 

So for the LQ problem with jumps, it is still far from the complete solution. The 
main purpose of this paper is to discuss detailed the stochastic LQ control problem with 
random coefficients where the linear system is a multidimensional stochastic differential 
equation driven by a multidimensional Brownian motion and a Poisson random martingale 
measure. In the paper, we will establish the connections of the multidimensional Backward 
stochastic Riccati equation with jumps (BSRDEJ in short form) to the stochastic LQ 
problem and to the associated Hamilton systems. By the connections, we show the optimal 
control have the state feedback representation. Moreover, we will show the existence and 
uniqueness result of the multidimensional BSRDEJ for the case where the generator is 
bounded linear dependence with respect to the unknowns martingale term. 

The rest of the paper is organized as follows. In section 2 we introduce useful nota- 
tion and some existing results on stochastic differential equations (SDEs in short form) 
and BSDEs driven by Poission random martingale measure. In section 3, we state the 
stochastic LQ problem we study, give needed assumptions and prove some preliminary 
property on the functional cost. Moreover, we have showed the stochastic LQ problem 
with jumps has a unique optimal control. In section 4, we establish the dual charac- 
terization of the optimal control by stochastic Hamilton system. In section 5, we will 
present the main results. In this section, we will introduce BSRDEJ and establish the 
link with the stochastic Hamilton system with jumps, then show the optimal control of 
the stochastic LQ problem has state feedback representation. In the end, we will focus 
on discussing the existence and uniqueness of the solution to BSRDEJ. 
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2 Notation and Preliminaries 

Throughout this paper, we let (Q, J 7 , {J-t}t>o, P) be a complete filtered probability 
space. In this probability space, there is a d- dimensional standard Brownian motion 
{W t }t>o and a stationary Poisson point process {i] t }t>o defined on a fixed nonempty 
measurable subset Z of R 1 . We denote by/i(de,dt) the counting measure induced by 
{Vt}t>o and by v(d&) the corresponding characteristic measure. Furthermore, We as- 
sume that v(Z) < oo. Then the compensate random martingale measure is denoted by 
p,(d9, dt) := fj,(d9, di) — v(d9)dt. We can assume that {J-t}t>*o is the P-augmentation of 
the natural filtration generated by {Wt} t >o and {?7 t } t >o- Denote by & the predictable 
sub-cr field of e^([0,T]) x then we introduce the following notation used throughout 
this paper. 

• H: a Hilbert space with norm || • \\h- 

• (a, (3) : the inner product in M n ,Vo;,/3 G M n . 

• |a| = y/(a,a) : the norm of M™, Va G W l . 

• (A, B) = tr(AB T ) : the inner product in R nxm , VA, B G R nxm . 

• \A\ = y/tr(AA*) : the norm of R™ xm ,VA G R" xm . Here we denote by A*, the 
transpose of a matrix A. 

• S n :the set of all n x n symmetric matrices. 

• S'l : the subset of all no n- negative definite matrices of S n . 



• (S n ) 1 : = S n x • • • x S n . 

i 

• Sjs-(0,T;H) : the space of all if-valued and ^-adapted cadlag processes / = 
{f(t,u), (t,u) G [0,T] x Q} satisfying 



• JC%(0, T; H) : the space of all if-valued and ^-adapted processes / = {f(t, ui), (t, cu) G 
[0, T] x tt} satisfying 



• C U ' 2 (Z; H) : the space of H- valued measurable functions r = {r(9),9 G Z} defined 
on the measure space (Z,38(Z);v) satisfying 



• ££ 2 ([0,T] xZ;H) : the space of C U,2 (Z\ iJ)-valued and J^-predictable processes 
r = {r(t,u,9), (t,u) G [0,T] x Q x Z} satisfying 
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• L 2 (f2, J 7 , P; H) : the space of all if-valued random variables £ on J 7 , P) satisfying 

llelUw,^) = E UWh < oo. 

Now we give two preliminary lemmas about SDE and BSDE driven by the <i-dimensional 
Brownian motion W t and the Poisson random martingale measure p,(d0,dt). which will 
often been used in this paper. 

Lemma 2.1. Let a an ^-measurable random variable and 

b: [0,T]xQxR n — > R n , 
a: [0,T]xttxR n — y R nxm , 
Ti : [0, T] x Q x Z x R n — y R n 

are given mappings satisfying the following assumptions 

(i) b, a and n are measurable with respect to 0?>xS3{R n )l S${R n ), @>x&{R n ) / '^(R nxd ), £?x 
m{Z) x SS{R n )jd§{R n ) respectively. 

(ii) 6(-,0) G C 2 T (0,T;R n ); a(-,0) G £^(0, T; R nxd ); tt(-,-,0) G C u /([0,T] x Z,R n ). 

(Hi) b,a and n are uniformly Lipschitz continuous w.r.t. x, i.e. there exists a constant 
C > s.t. for all (t,x,x) G [0,T] xl"xf and a.s. u E tt, 

\b(t,x) - b(t,x)\ 2 + \a(t,x) - a(t,x)\ 2 

+ j \n(t,9,x) -ir{t,6,x)\ 2 v{d6) < C\x-x\ 2 . ^'^ 

Then the SDE with jumps 



X t = a+ / b(s,X s )ds + / o-(s,X s )dW s + 



Zx(0,T] 



ir(s,6,X a -)fi(de,ds) (2.2) 



has a unique solution X G Sjr(0,T; R n ). Moreover, the following a priori estimate holds 



E sup \X t \ 2 < K 

0<t€T 



E [ \b(t,0)\ 2 dt + E [ \a(t,0)\ 2 dt 
Jo Jo 



+ E 



\n( y t,9,0)\ 2 u(d9)dt + E\a\ 



(2.3) 



>Zx(0,T] 

where K is a positive constant depending only on Lipschitz constant C and T. 
Lemma 2.2. Let £ an Ft -measurable random variable and 

f : [0, T] x ft x R n x R nxd x C U ' 2 (Z; R n ) — > R n (2.4) 
is a given mapping satisfying the following assumptions 

(i) f is measurable with respect to & x ^(R n ) x ^(R nxd ) x 3§(C U > 2 (Z; R n ))/£$(R n ) 

(ii) /(-, 0, 0, 0) G £3,(0, T; R n ); £ G £ 2 (ft, J 7 , P; iT). 

(raj / is uniformly Lipschitz continuous w.r.t. (y,q,r), i.e. there exists a constant C > 
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s.t. for all (t,y,q,r,y,q,f) G [0,T] x R n x M nxd x C v > 2 {Z;R n ) x R n x R nxd x C u > 2 (Z;R n ) 
and a.s. uj G 



\f{t,y,q,r) - f(t,y,q,r)\ 2 



< C 



v-v\ +\q-q\ + / |r(0)-f(0)|v(<*0) 



(2.5) 



T/ien t/ie BSDE with jumps 

Y t = £+ f f(s,Y s ,Q s ,R s )ds- I Q s dW s - [[ R 8 (0) fi(d9 , ds) (2.6) 

Jt Jt JJzx(t,T] 

has a unique solution 

(Y, Q, R) G S 2 jr{0,T-R n ) x C%(0,T;BT xd ) x C u /{[0,T] x Z;i? n ). 
Moreover, we have the following a priori estimate 



E sup \Y t \ 2 + E I \Q t \ z dt + E 



\Rt(6)\ 2 v(d9)dt 



Zx(0,T] 



El \f(t,0,0,0)\ 2 dt + E\tf 
Jo 



where K is a positive constant depending only on C and T . 
Particularly, if 

M:=sup / \f(t,u,0,0,0)\ 2 dt + |£(w)| 2 <x. 

then for all t G [0,T] and a.s., we have 

\Y t \ 2 <M-e KT } 

where K is a positive constant depending only on Lipschitz constant C. 



(2.7) 



(2- 



(2.9) 



Proof. The proof of the existence and the uniqueness can be found in [19j. In the fol- 
lowing we will only proof the estimate (12.91) . As for the a priori estimate (12.71) . it can be 
obtained similarly by Gronwall's inequality and Burkholder-Davis-Gundy inequality. In 
fact, for any given < r < t < T, applying Ito's formula to \y t \ 2 and takeing conditional 
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expectation with respect to J>, we have 



E Tr \Y t \ 2 + E Tr I \Q s \ 2 ds + E Tr II \R s {9)\ 2 v{d6)ds 

Jt JJzx(t,T] 

J 2(f{s, Y s , Q s , R s ), Y s )ds + Ef* |£| 2 



^ I 2\f(s,Y 8 ,Q 8 ,R.)\\Y s \ds + E J -*\Z\ 



I £ I 2 



^ J 2|/(s, Y s , Q„ R s ) - f(s, 0, 0, 0) + f(s, 0, 0, 0) \\Y.\ds + E^ |£| 2 
^h ETr I \f( 8 > Y »Q» R ')- f(s,0,0,0)\ 2 ds + 2CE^ J \Y s \ 2 ds 

r T r T 

+ E Tr / \f(s,0,0,0)\ 2 ds + E Tr I \Y s \ 2 ds + E Tr \£\ 2 
Jt Jt 

^(2C+~)£^ / \Y s \ 2 ds + ]-E^ I \Q s \ 2 ds + lE^ II \R s {9)\ 2 v{d9)ds 

* Jt * Jt * JJzx(t,T] 



(2.10) 



+ E 



|/M,0,0)| 2 ci S + 7- r |ep 



where the Lipschitz condition (12. 5p and the basic inequality 2ab ^ f3a 2 + — b 2 , V/3 > 0, a > 
0, b > are used. Therefore, we have 



E Tr \YA 2 <E Tr 



\f(s,0,0,0)\ 2 ds+\tf 



+ {2C + -)E 



\\)sfds 



<M + K J E Tr \Y s \ 2 ds, 



where we set L = 2C + -. 

Consequently, applying Gronwall's inequality, we get 

E Fr \Y t \ 2 <: Me K{T - t \ O^r^t^T. 
In the end, particularly taking r = t, we obtain the estimate (I2.9p 



(2.11) 



(2.12) 
□ 



3 Formulation of the problem and Elementary Re- 
sults 

Consider the following linear stochastic system derived by Brownian motion W t and Pois- 
son random measure p,(d6, dt) 
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dX t = (A t X t + B t u t )dt + Yj&Xt + D\u t )dWl 

f 1=1 (3-1) 

Jz 

X = X. 

The process u in (13 .ip is our control process. An admissible control u is defined as a 

{Ft, < t < T}-predictable process with values in R m such that E I \u{t)\ 2 dt < +oo. 

Jo 

The set of all admissible control u is denoted by A. Note that A is a Hilbert space. 

And for any admissible control u 6 A, we consider the following quadratic cost func- 
tional 

J(u) = e[ [{Q t X t ,X t )dt+{N t u t ,u t )]dt + E{MX T ,X T ), (3.2) 

where A is the strong solution to the state equation ( I3.ip . 

Throughout this paper, we make the following assumptions on the coefficients A, B , C l , D l , 
E, F, Q, N and M. 

Assumption 3.1. The matrix processes A : [0,T] x ft -> R nxn ,B : [0, T] x -> 
fl" xm ; (7* : [0,T] xfl4 J R nxn , D i : [0,T]xfi^ i?" xm , i = 1, 2, • • • , d; E : [0, T] X Q -> 
C v ' 2 (Z;R nxn ),F : [0, T] x Q -> £^- 2 (Z; iT xm ); Q : [0, T] x SI -> R nxn ,N : [0,T] x -> 
i? mxm ; and the random matrix M : Q — > R nxn are uniformly bounded and {Ft, < t < 
T}-predictable or J^-measurable. 

Assumption 3.2. The state weighting matrix process Q and the control weighting matrix 
process N e. symmetric and nonnegative. The terminal state weighting random 

matrix M is a.s. symmetric and nonnegative. The control weighting matrix process N is 
a.s. a.e. uniformly positive, i.e. N(t) > 51 for some positive constant 5 and almost all 
(t,u) G [0,T] x n. 

Under Assumption 13.11 from Lemma 12.11 the system (13. ip admits a unique solution 
strong solution, which will be denoted by X^ x ' u ^ or X if its dependence on admissible 
control u is clear from the context. Then we call X the state process corresponding to 
the control process u and (u; X) the admissible pair. Furthermore, from Assumption 13.21 
and the a priori estimate (12.3p . it is easy to check that 

\J{u)\ < oo. 

Then we can pose the so-called linear quadratic (LQ) problem. 
Problem 3.1. Find an admissible control u such that 

J{u) = inf J(u) 
ueA 

Any u G A satisfying the above is called an optimal control process of Problem 13.11 
and the corresponding state process X is called the corresponding optimal state process. 
We also refer to (u; X) as an optimal pair of Problem 13.11 



(3.3) 



S 



Lemma 3.2. Under Assumptions \3.1]\3.£\ the cost functional J is strictly convex over A. 
Moreover, lim J{u) = +00 

Proof. Under Assumption 13.21 by the definition of cost functional J (see (13.21) ). it is easy 
to check that J is a convex functional. Since the weighting matrix process N is uniformly 
strictly positive, we can conclude that J is strictly convex over A. Moreover, in view of 
the nonnegative property of Q, M and the uniformly strictly positive property of N, we 
have 



> J{u) >5E [ \u t \ 2 dt = S\\u\\ 2 A . 
Jo 



Therefore, lim J{u) = +00. 
ll«IU->°o 



□ 



Lemma 3.3. Under Assumptions \3.1\\3.2l the cost functional J is Frechet differentiable 
over A. Moreover, the corresponding Frechet derivative J' at any admissible control u G A 
is given by 



>j'(u),v) = 2E [ 
Jo 



(Q t x\ x ' u \xp v) ) + (N t u t ,v t ) 



dt + 2E(MX^ u) , X ( V' V) ) , WveA, 

(3.4) 

where X^°' v ^ is the solution of the SDE (13. ip corresponding to the admissible control v 
and the initial value Xq = 0, and X <yX,u ' > is the state process corresponding to the control 
process u. 

Proof. For Vit, v G A, we define 

A J := J{u + v) - J{u)-2E f [(Q t xt' u \x$°' v) ) + (N t u t , v t )] dt - 2E(MX^ U \ X$' v) ), 

Jo 

Then from the definition of cost functional J (see( !3.2p ). we have 



AJ=E 



T 



(x,u) _|_ x(°' v )\ x^ x ' u ^ + x^°' v ^ 

+ E(M(X ( T X ' U) + Xp v) ),X { *> u) + Xp v) ) -E [ 

Jo 

+ (N t u t , u t )] dt - E{MXp u \xp u) ) -2E [ 
J Jo 

+ (Q t u t , v t )} dt - 2E(MX^ u \xp v) ) 



dt 



(Q t X { t x ' u \x { t x ' u) ) 
(N t xf' u) ,X$ ' v) ) 



(3.5) 



--2E 



T r 



(Q t X^\x^) + (N t v t ,v t ) 



dt + 2E(MX { °> v \x { °' v) ) 



Then it follows from Assumptions 13.11 and the a priori estimate ( 12.31) that 

cT 



AJI < KE \ \v t \ 2 dt = K\\v\ 



|2 
U 
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Consequently, we deduce that 



lim n ^- = 0, 

l«U-+o \ \v\\a 



which implies that J is Frechet differentiable and its Frechet derivative J' is given by 
flUD- □ 

Theorem 3.4. Under Assumptions \3.1W3.2l Problen i3.1\ has a unique optimal control u. 

Proof. In view of the fact that the cost functional J is Frechet differentiable, strictly 
convex and lim J{u) = +00, the existence and uniqueness of the optimal control can 

be directly obtained by Proposition 2.1.2 in [8]. □ 

Theorem 3.5. Under Assumptions \3. 1\\3.2[ a necessary and sufficient conditions for an 
admissible control u G A to be an optimal control of Problem \3.1\ is for any admissible 
control v G A, 

(J'(u),v-u} = 0. (3.6) 

Proof. Since the cost functional J is Frechet differentiable and strictly convex, according 
to Proposition 2.2.1 in [8], we conclude that a necessary and sufficient conditions for an 
admissible control u G A to be an optimal control of Problen i3.ll is for any admissible 
control v G A, 

(J'(u),v-u)>0. (3.7) 

Since the above inequality is hold for any v G A, we can replace v in the above inequality 
by 2u — v and get 

(J'(u),v-u) < 0. (3.8) 
Thanks to (E2D and (ETBjl . we obtain (EE} □ 

Corollary 3.6. Under Assumptions \3. 1\\3. 2\ a necessary and sufficient conditions for an 
admissible control u G A to be an optimal control of Problem \3.1\ is the Frechet derivative 
of J at the admissible control u G A given by 

J\u) = 0. (3.9) 

Proof. In the equality (13.61) . replacing v by v + u, we have (J'(u),v) = 0, G A, i.e. 
J'iu) = 0. Thus the equality (13.61) and the equality (13. 9ft is equivalent. So the proof can 
be completed directly by Theorem 13.51 

□ 



4 Stochastic Hamilton Systems 

This section will focus on establishing the dual characterization of the optimal control by 
stochastic Hamilton system. 

Let (w, X) be an admissible pair, then the corresponding adjoint BSDE of the stochas- 
tic systems (13. ip is defined by 
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dp t 



d „ 

A* t p t + J2C?qi+ / E* t (6)r t (6)v(d6) + 2Q t X t dt 
i=i Jz J 



i=i 



+ Y;<£dW*+ / r t {9)fi{d9,dt) 



(4.1) 



k p T = 2MX T , 

Note that under Assumption 13. 1[ from Lemma 12. 2\ we see that the equation (14. ip 
admits a unique solution 

(p )ff ,r) G ^(0,T;iT) x ^(0,T;iT) x C/([0,T] x Z;iT). 

We define the Hamiltonian function H : [0, T]xR n x R m x iT x iT xd x £^ 2 (Z; iT) — y 
Rbj 

H(t,x,u } p,q } r) 

d „ 

=(p, A t x + B t «) + V (<f , Cfc + Djtt) + / (r(0), £ t (0):c + F t {G)u)v{dO) (4.2) 
i=i 

+ (Q t x,x) + (N t u,u). 
Then we can rewrite the adjoint equation (14. ip in Hamiltonian system's form: 



d „ 

dp t = -H x (t,X t ,u t ,pt,qt,r t )dt + y2qidWi + / r t (9)fl(d9,dt), 

i=i Jz 

p T = 2MX T . 

Now we give the the dual characterization of the optimal control. 



(4.3) 



Theorem 4.1. Let Assumptions \3.1W3.S\ be satisfied. Then, a necessary and sufficient 
condition for an admissible pair (u, X) to be an optimal pair of Problem \3.1\ is 



i.e., 



H u (t,X t _,u t ,p t _,q t ,r t ) = 0, a.e.a.s., 



d „ 

2N t u t + B* Pt _ + V Dfql + / F*(9)r t (9)u(d9) = 0, a.e.a.s.. 
i=i Jz 



(4.4) 



(4.5) 



Here (p, q, r) is the solution of the adjoint equation (14. ip corresponding to the admissible 
pair (u, X). 



Proof. By Corollary I3.6[ in order to prove Theorem 14.11 we only need to show the equality 
1 13. 9ft and the equality ( 14. 4p or ( 14. 5ft are equivalent. Indeed, let (u,X) is an admissible 



pair. From lemma 13.31 for any admissible control v E A, we have 

t-T r 



(J'(u),v) = 2E I 
Jo 



(N t X t , JQ (M ) + (Q t u t , v t ) 



dt + 2E(MX T ,Xp v) ). (4.6) 
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On the other hand, recalling the adjoint equation (14. ip and the state equation (13. ip . 
applying Ito's formula to (X^°' v \p t ) and taking expectation, we have 

2E(MX Tl X^' v) ) = E{p T ,Xp v) ) 

=E [ T (p s , A S X^ + B s v s )ds + V E [ T (ql C\Xf^ + D l s v s )ds 
Jo i=1 Jo 

+ E [ T (X^\-A: Ps -J2CTql - [ E* s {9)r{9)v{d9)-2Q s X s )ds 
Jo i=1 Jz 

+ E [[ (r s (6), E S (9)X^ + F s {6)v s )v{d6)ds 

J Jzx{0,T] 

=E [ T (B: Ps + V DlX + [ F* s {9)r s {9)v{d9),v s )ds 
Jo i=l Jz 

-2E / (Q s X s ,X^)ds, 
Jo 



(4.7) 



Hence 



2E(MX T ,X^ v) ) + 2E [ (Q t X s ,X^ v) )ds + 2E [ (N s u s ,v s )ds 

Jo Jo 

=E [ (B* sPs + y2Dfqi+ [ F:(9)r s (9)p(d9) + 2N s u s ,v s )ds. 
Jo i=1 Jz 

Combining (14.61) and (14. 8 1) , we get 

(J'(u),v) 

=E [ (5; ft + VDf g j+ / F:(9)r s (e)u(de) +2N s u s ,v s )ds 
Jo i=l Jz 

=E (H u (s,X s _,u s ,p s _,q s ,r s ),v s )ds, Vv 6 A. 
Jo 



(4.8) 



(4.9) 



Since the v G A in (14.91) is arbitrary, we deduce that the equality (13. 9p and the equality 
( 14.51) or ( 14.41) are equivalent. Then the desired result then follows. □ 

Corollary 4.2. Let assumptions \3.1W3.2\ be satisfied. Then, Problen i3.1\ has a unique 
optimal control pair (u,X), where the optimal control u have the dual representation 



d „ 

B* tPt _+Y,Di*qi+ / F t *(9)r t (9)v(d9) 
L i=1 Jz 



< t < T. 



(4.10) 



Here (p, q, r) is the unique solution of the adjoint equation (14.11) corresponding to the 
optimal control pair (u, X). 
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Proof. From Theorem I3.4[ we know that Problem 13.11 have an unique optimal control 
pair(w, X). Furthermore, by Theorem 14.11 and the equality (14. 5p . the optimal control is 
given by ffl~TU|) . □ 

Now we can introduce the following so-called stochastic Hamilton system which con- 
sists of the state equation ( 13.11) . the dual equation ( 14.1 ft and the dual representation (14. 101) 
by 



dX t = (A t X t + B t u t )dt + J2( C i X t + D l t u t )dWi 

i=l 

+ / (E t (9)X t ^ + F t (9)u t )fl(d9,dt), 
Jz 

1 r 



Ut 



dpt 



--N: 



B* tPt _ + J2Di*qi+ [ Ft(6)r t (6)v(d0) 
i=i Jz 

d „ 

A* tPt + T + / El{9)r t {9)v{d9) + 2Q t X t 



dt, 



{ x 



+ Vg t W/+ / r t (9)jl(d9,dt), 
x, p T = 2MX T . 



(4.11) 



Clearly it is a fully coupled forward-backward stochastic differential equations (FB- 
SDEs in short form) driven by Brownian motion W and Poisson random martingale 
measure jl(d9,dt). The solutions consist of the stochastic process quaternary (X,p, q, r). 

Theorem 4.3. Let assumptions \3.1]\3.2\ be satisfied. Then the stochastic Hamilton system 
(gXED has a unique solution (X,p,q,r) e Sj-(0, T; BJ 1 ) x S]r(0,T;R n ) x Cj:(0,T;R 



nxd\ 



X 



£ V /([0,T] x Z;R n ). And u in ( 14. lip is the optimal control of the stochastic LQ Problem 
\3.1[ the stochastic process X is the corresponding optimal state. Moreover, the following 
a priori estimate holds 



E sup \X t \ 2 + E sup \p t \ 2 + E [ \q t \ 2 dt + E [[ \r t {0)\ 2 v{d6)dt *C K\x\ 2 , (4.12) 



'0 JJZx(0,T] 

where K is some deterministic positive constant. 



Proof. The existence result can be directly obtained by Corollary (14. 2D . The uniqueness 
result is obvious once the a priori estimate (14.121) holds. Therefore, it remains to prove 
that the a priori estimate (14.121) hold. 

Let (X, p, q,r) is a solution of the stochastic Hamilton systems (14. lip . Using Ito's 
formula (p t ,X t ), we get 

2E(MX T ,X T ) + 2E [ (N t u t ,u t )+2E I (Q t X t ,X t )dt = E(p ,x). (4.13) 
Jo Jo 

In the following, K will denote a generic positive constant and might change from line 
to line. 
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For the backward part of the stochastic Hamilton systems (14.111) . using the a priori 
estimate (12. 7p for BSDEs, we have 

Esup ^ T \p t \ 2 + E [ \q t \ 2 dt + E [[ \r t {6)\ 2 v{d6)dt 

J0 JjZx{0,T] 
|2 



E [ \Q t X t \ 2 dt + E\MX T \ 
Jo 



E / (Q t X t ,X t )dt + E(MX T ,X T ) 



^ K 



^ K 



^ KE( Po ,x) 
< KE\ Po \\x\ 

<: ^E\p \ 2 + K\x\ 2 

1 l2 

^ -E sup \pt\ + K\x\ 

2 O^t^T 



(4.14) 



where we have used the nonnegative property of Q and M, the equality f 14 . 1 3 1) and the 
elementary inequality 

2ab^ea 2 + -b 2 , We > 0, a > 0, b > 0. 

e 

Hence we get 

E sup \p t \ 2 + E [ \q t \ 2 dt + E [[ \r t (6)\ 2 vd(6)dt^K\x\ 2 . (4.15) 

CK^T Jo JJ(0,T]xZ 



On the other hand, for the forward part of the stochastic Hamilton systems (14. lip , 
using the a priori estimate (12. 3 p for SDEs, we have 



E sup \xt\ ^ K 

0<t<T 

SC K 

sc if 
< K 
^ K 



E / \u t \ 2 dt + \x\ 
o 

T 



E / (iV t u i ,M t )dt+ |x| 2 
E(po,x) + \x\ 2 

e\po\\x\ + \ x \ 2 

E\p \ 2 + \x\ 



(4.16) 



^ K 
^ K\x\ 2 



E sup \p t \ + |x| 

O^t^T 



where we have used the nonnegative property of N, the equality (I4.13p . the elementary 
inequality 2ab ^ ea 2 + -b 2 , We > 0, a > 0, b > 0, and the inequality (I4.15p . 
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Combining the inequality (I4.15P and the inequality (I4.16p . the inequality (I4.12p is 
directly obtained. The proof is complete. □ 



In summary, the stochastic Hamilton system (14. lip completely characterizes the op- 
timal control of LQ problem. Therefore, solving LQ problem is equivalent to solving the 
stochastic Hamilton system, moreover, the unique optimal control can be given explicitly 
by {HDD. 

5 Backward Stochastic Riccati equation with jumps 

Although the stochastic Hamilton system (14.111) is a complete characterization of the 
stochastic LQ problem, it is a fully coupled forward-backward stochastic differential equa- 
tion. The solution to (14. lip would be hard to be solved so that this characterization is 
also not satisfactory. As the stochastic LQ theory in Brownian motion framework (see 
[T8]). it is natural to connect the stochastic LQ problem with stochastic Riccati equation. 
In this section, we will introduce stochastic Riccati equation with jumps and establish 
the link with the stochastic Hamilton system (14.111) . then show the optimal control of the 
stochastic LQ problem has state feedback representation. In the end, we will focus on 
discussing the existence and uniqueness of the solution to the stochastic Riccati equation 
with jumps. 

5.1 Derivation of stochastic Riccati equation with jumps 

In the following, by dynamic programming principle, we will derive the general form of 
the stochastic Riccati equation with jumps. 

Now consider the following parameterized stochastic LQ problem on the initial time t 
and the initial state x: 

The state equation 

d 

dX s = (A S X S + B s u s )ds + ^(C*X S + D\u s )dWl 

f 1=1 (5-1) 
Je 

k X t = x, < s < T. 
The cost functional 

ds + E Tt (MX T ,X T ). (5.2) 
Define the value function by 

:= inf J(t,x;u). (5.3) 
ueA 

Then the value function {§ t (x),t G [0, T],x G R n } is a family of { F t) < t < T}- 

adapted processes with values in R. In general, for any x G R n , $t(x) is not a bounded 



J(t, x; u) := E 



l 



(Q S X S ,X S ) + (N s u s ,u s ) 
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variation function with respect to t. So we can only expect that {<& t (x), t € [0, T], x G R n } 
is a family of semimartingales with the decomposition 

d r T 



(Mx,x)+ [ r s (x)ds-Y"/ Ai(x)dW}- ff tf.(0, 

A i=1 7t J J(t,T]xZ 



x)p,{dB,ds). (5.4) 



(5.5) 



Furthermore, suppose 

$t(x) = (K t x,x); 
A l t (x) = (L]x,x),i = 1,2, • • • ,d; 

V a (9,x) = (H t (0)x,x), t e [0,T],x e R r \9e Z, 

where K is a symmetric matrix- valued {J~t, < t < T}-adapted process, L l (i = 1, 2, • • • , d) 
and H are symmetric matrix- valued {J-j, < t < T} -predictable processes. Firstly, us- 
ing the dynamic programming principle (see [15]) and Ito-Ventzell formulation with jumps 
(see [5]), we deduce that T t (x) in the semimartingale decomposition (15. 4p have the follow- 
ing expression 

T t (x)= inf \(D^ t (x),A t x + B tU } + ly^(D 2 ^ t (x),(Clx + Dlu)(Clx + Dl U y} 



8=1 



+ y^(DA*(x), C\x + D\u) + (Q t x, x) + (N t u, u) 

tr (5.6) 

+ / [^ t (x + E t (9)x + F t (9)u)-^ t (x)-(D^ t (x),E t (9)x + F t (9)u)]u(d9) 

+ / [V t (9,x + E t (9)x + F t (9)u)-%(9 7 x)]v(d9) 
Jz 

where DQ t (x) and DA t (x) is the gradient of $t(x) and A t (x) with respect to x respectively, 
D 2 § t (x) is the Hessian of $t(x) with respect to x. Now substituting the relationship (I5.5P 
into (15.61) . we get 

d d d 



F t (x) = inf 

u&R m 



X. 



K t A t + A\K t + L\ci + °i* L i + E c t* K t c t 



8=1 8=1 i=l 

+ / H t {9)E t {9)p{d9) + / E* t {9)H t {9)v{d9) 
J z J z 

+ / E* t {9)K t E t (9)v{d9) + [ E* t {9)H t {9)E t {9)v{d9) + Q t 



x 



+ 2(u, 



(5.7) 



+ / F t *(9)H t (9)v(d9) + / F t *(9)K t E t (9)v(d9) 



+ / F t *(9)H t (9)E t (9)p(d9) 
Jz 

+ [ F t *(9)K t F t (9)u{d9) + 



2 ) + ( u 



iV t + J] D t K t D t 



i=l 



F t *{9)H t {9)F t {9)v(d9) 



z 
16 



Ii is obvious that for V(£, x, u) G [0, T] x R n x Q, T t (x) is the Quadratic functional extreme 
with respect to u G R T ' 



d 



Furthermore, if N t + D\*K t D\ + / F*{6)K t F t {6)v{d6) + / F t *{9)H t {9)F t {9)v{d9) 

i=1 Jz Jz 

is strictly positive definite, then it follows that the infimum in (15. 7p is obtained at 



d „ 

= - i^ + Vl)f^ + / F?(9)K t F t (9)u(d9) 
L .=1 

„ -i —1 / d d 

+ / F t *(9)H t (9)F t (9)u(d9) [B* t K t + D?K t C\ + J2 D ? L t 
•* z -I \ i=i i=i 

+ [ F t *(9)K t (9)E t (9)u(d9) + [ F t *(9)H t (9)u(d9) 
Jz Jz 



(5.1 



+ Jj;{9)H t {9)E t {9))u{d9)\x 

Combining (15 .4ft . H5. 51) . (15. 7D and (15. 8D . we deduce that the matrix- valued processes 
(K, L, H) satisfy the following Riccati equation 



d „ 

dK t = -G t -Q t + B t N^B* t dt + V L\dWl + / H t (9)/i(d9, dt), 

i=i Jz 



(5.9) 



K T = M, 



where 



c t -.=K t A t + A\K t + Lict + £ °i* L t + E <% K A 

i=l i=l i=l 

+ / H t (9)E t (9)v(d9) + / E*(9)H t (9)u(d9) 



(5.10) 



+ / E* t {9)K t E t {9)p{d9) + / E* t {9)H t {9)E t {9)v(d9)i 
i z Jz 



Bt =K t B t + L\Di + C?K t D\ 
i=i i=i 

+ / H t (9)F t (9)v{d9) + / E* t {9)K t F t {9)v{d9) ( 5 - n ) 



+ / E${9)H t {9)F t {9)v{d9), 



z 



d p 

N t =N t + Y^Dl*K t Dl*+ / F t *(9)K t F t (9)u(d9) 
i=x Jz 

F t *{9)H t (9)F t {9)u(d9). 



(5.12) 
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It is a high order nonlinear backward stochastic differential equations with the generator 
— G t — Qt + BtN^B*, the unknown elements are the triple matrix process (K,L,H). 
The above backward stochastic Riccati differential equation with jumps will be hereafter 
abbreviated as BSRDEJ. 

Now we give the rigorous connection of BSRDEJ (15.91) to the stochastic Hamilton 
system (14.111) and to the stochastic LQ Problem 13.11 

Theorem 5.1. Let Assumptions \3.1\\3.2\ be satisfied. Let (X,p,q,r) be the solution of 
the stochastic Hamilton system (14.111) with u being the optimal control. Assume that 
(K, L, H) G Sjr(0, T; S n ) x C 2 T (0, T; (S n ) d ) x C u /([0, T] x Z; S n ) is the solution to BSRDEJ 
(15.91) and the matrix-valued process N (noting (15.121) ) is a.e.a.s. positive definite. Then, 
we have, for t G [0, T] and 9 G Z 

Vt = KtX t ; 

q\ = (Ll + Kt-CftXt- + K t .D*Ut, % = 1, 2, ■ ■ • , d- 
r t (9) = \ H t (9) + K t _E t (9) + H t (9)E t (9]\X t ^ (5-13) 

+ (K t _F t {9) + H t (9)F t (9))u t . 



Proof. Use Ito formula to compute K t x t and compare it with p t . The identification of the 
integrands of Lebesgue and Ito's integrals yields the desired relation (I5.13p . □ 

Now we give the state feedback representation of optimal control u. 

Theorem 5.2. Let Assumptions \3.M3.S\ hold. Let (u,X) be the optimal pair of the 
stochastic LQ Problem\3Ji Assume that (K,L,H) G S]r(0,T;S n ) x £ 2 T (0,T; (S n ) d ) x 
£^ 2 ([0, T]xZ; S n ) is the solution to BSRDEJ (15. 9ft and the matrix-valued process N (noting 
(I5.12p ) is a.e.a.s. positive definite. Then u has the following state feedback representation 



d „ 

N t + y*Di*K t _Di+ / F t *(9)K t _F t (9)v(d9) 

r 1 _1 r d 

+ / F t *(9)H t (9)F t (9)u(d9) B* t K t „ + ^L>f# t -Q 
Jz J L i=1 

+ J2D?Ll + [ F t *(9)K t _(9)E t (9)v(d9)+ [ F t *(9)H t (9)v(d9) 
i=1 Jz Jz 

+ / Fl{9)H t {9)E t {9))v{d9) X t _, a.e.a.s.. 



(5.14) 



z 



Moreover, the following relation holds 

inf J{u) = E(K x,x). 

Proof. Putting into the relationship (15. 13f) into the dual representation (14.51) . we get the 
state feedback representation (15.141) . Since (u,X) is the optimal pair, combining the 
relationship (I4.13P and the first relationship in (I5.13p . we get 
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inf J(u) = 2E(Mx T ,x T ) + 2E [ (N t u t ,u t )dt + 2E [ (Q t x t ,x t )dt 
u ^ Jo Jo 

= E(P ,x) = E(K x,x). 
The proof is complete. 



(5.15) 



Remark 5.1. Formula (I5.14p provides a characterization of the optimal control in the 
terms of the solution to BSRDEJ (15. 9p . BSRDEJ (15. 9p is not a coupled equation, and 
this characterization is preferred to (14. lip . 

Remark 5.2. Putting (15. 14j) into the second equality and the third equality of (I5.13p . 
we have 

d „ 

q\ = (L\ + K t -Ct)X^ + Kt-D\ N t + Y^D?K t -D\ + / F t *(9)K t ^F t (9)v(d9) 

L i=l Jz 

r i _1 r d 

+ / F t *(9)H t (9)F t (9)v(d9) B* t K t „ +J2 D ? K t-C\ 
Jz J L i=1 

+ J2D?Ll + [ F t *(9)K t 49)E t (9)v(d9)+ [ F t *(9)H t (9)v(d9) 



i=l 



+ / F t *(9)H t (9)E t (9))v(d9) 



i = 1,2, ••• ,d; 



r t (9) = H t (9) + K t -Et(0) + H t {9)E t {9) )X t 



+ 



K t .F t (9) + H t (9)F t (9)) U + V D**iir t _D* + / F t *(9)K t _F t (9)v(d9) 

' - i=i Jz 

d d 

B;K t _ + Y,D?K t _Cl + Y. D ? U t 



+ / F t *(9)H t (9)F t (9)u(d9) 



i=l 



i=l 



+ / F*(9)K t _(9)E t (9)u(d9)+ / F t *(9)H t (9)v(d9) 
'z Jz 



+ / F t *(9)H t (9)E t (9))v(d9) 
'z 



x t _, te[o,T), 9ez. 



5.2 Existence and uniqueness of BSRDE with jump 

From Theorem 15.21 we know that the optimal control u of the stochastic LQ Prob- 
lem [XT] can be expressed by the solution (K,L,H) to the BSRDEJ (15. 9p . Therefore, 
solving stochastic LQ Problem 13.11 is equivalent to solving the BSRDEJ (15. 9p . But the 
BSRDEJ (15. 9 p is a high order nonlinear backward stochastic differential equation with 
jumps. And the general theory of BSDE (see lemma 12 .2 j) can be not applied to use 
to guarantee the existence and uniqueness of its solution. Moreover, different from the 
BSRDE driven only by Brownian motion (see Tang [18]), the BSRDEJ (15. 9 p has also a no- 
table characteristic: the nonlinear term Nf 1 = (N t + D\*K t D\ + / F*(9)K t F t {9)v{d9) + 
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/ Ft(9)Ht(9)Ft(9)p(dO)) 1 contains not only the first unknown element K, but also the 
Jz 

third unknown element H. For the BSRDE driven by only Brownian motion, the nonlin- 
ear term Nf 1 is degenerated into (N t + D\* K t D\)~ l which only contain the first unknown 
element K t . In [TB], we can proof the K t is non-negative matrix, so (N t + D\* KfDl)^ 1 is 
well defined. For the second unknown element L, we can only show it's square integra- 
bility, but we can not show if it is a non- negative matrix. So for the BSRDE J (15. 9p . how 

to guarantee {N t + DfK t D\+ [ F*{9)K t F t {9)v{d9) + f F t *( y 9)H t (9)F t ( y 9)u(d9))- 1 to be 

Jz Jz 
well-defined is posed to be a challenging problem. 

In this paper, we show the existence and uniqueness result only for the case where the 

generator is a bounded linear dependence with respect to the second unknown element L 

and the third unknown element H. For the general case, we will to continue the discussion 

in future research . 

Now we give the further assumptions on the coefficients of stochastic system (13. ip . 
Assume that the coefficients 

C ={C\ ■ ■ ■ , C d ) = (C 11 , ■ ■ ■ , C ldl , C 21 • • ■ , C 2d2 ), 
D=(D\--- ,D d ) = (D 11 ,--- ,D ld \0--- ,0), 
F=0, 

where d 1 + d 2 = d. 

In this case the stochastic system (13 .ip is reduced to the following form 



di 

2i 
t 

i=l i=l 



dX t = {A t X t + B t u t )dt + Ct l X t dW t li + J2(°t tX t + Dfu t )dW i 

8=1 

E t (9)X t _fi(d9,dt) 



(5.16) 



z 



Xq — X, 



Denote by {^*}t^o the P-augmentation of the natural cr-filtration which is generated 
by Brownian motion (W 11 , • • ■ , W ldl ) and Poisson random martingale measure p,(d9, dt). 
In the following we give the further assumptions on adaption of the coefficients of the 
stochastic LQ problem. 

Assumption 5.1. Assume that A, B,C, D, E,Q, N are uniforming bounded {^,0 < 
t < T}-predictable matrix-valued processes. And the random matrix M is bounded 
J^-measurable. 

Under Assumption 15.11 again by dynamic programming principle and Ito-Ventzell 
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di d\ d\ 

K t A t + A* t K t + C?%" + L t tC t l + E <?t 

i=l i=l i=l 

d 2 



formulation, BSRDEJ (I5.9P is reduced to the following form 
dK t = 

+ f]C?*K t C? + [ H t (9)E t (9)u(d9) + [ E* t (9)H t {9)v{d9) 
i=l J z Jz 

+ f E* t (9)K t E t (9)u(d9) + [ E;(6)H t (6)E t (6)v(dd) 
Qt — B(t, K t )N~ L (t, K t )B*(t, K t ) dt 

+ J2LidW t u + / H t (9)fi(d9,dt), 



(5.17) 



where for \/K G S n , we define 



<i 2 



£?(t, A") + CfKD 2i \ 



i=l 



d 2 



(5.18) 



iV(t, #) :=iVt + D 2i *KD 2i . 



i=l 



In the following we state the existence and uniqueness result of the solution BSRDEJ 

tfLHD- 

Theorem 5.3. Let Assumption \3.2\ and Assumption I5.il hold. Then BSRDEJ (15. 17j) 
has a unique solution (K, L, H) e S|-(0,T;S n ) x C%{Q,T; (S n ) dl ) x £ U /([0,T] x Z;S n ). 
Moreover, K is uniformly bounded and nonnegative a.s.a.e.. 

In order to show the theorem, we need the following two lemmas. 
Consider the following linear BSDE 



-dK t 



di d\ d\ 

K t A t + A\k t + W + £ d t"L] 1 + E CpKtC? 

i=l i=l i=l 

d2 p. p. 

+ Y,C 2l *K t C 2l + / H t (9)E t (9)u(d9) + / E* t {9)H t {9)v{d9) 



8=1 



+ / E* t {9)K t E t {9)v{d9) + / E* t {9)H t {9)E t {9)v{d9) + Q t 



dt 



(5.19) 



Y^W"- / H t (9)fl(d9,dt), 
i=i Jz 



K T = M. 



Lemma 5.4. Let 1,(7^ = 1, 2, • • • , d x ), C 2i (i = 1, 2, • • • , d 2 ), E be R nxn -valued, and 
Q be S n -valued, uniformly bounded {^,0 < t < T} -predictable process. Let M be S n - 
valued bounded ^-measurable random variable. Then BSDE (15.191) has unique solution 
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(K, L, H) e S^{0,T;S n ) x £%(0,T; (5 n ) dl ) x £g([0,T\ x Z;S n ). Moreover 



sup \K t {uj)\ 2 ^ K Q < +00, 
(t,w)e[o,T]xn 



sup |MH| 2 + / |&(w)| 2 dt ■ 



where ko depends on 



If Q and M are nonnegative a.s.a.e, then K is also nonnegative a.s.a.e.. 



(5.20) 



(5.21) 



Proof. According to Lemma 12. 2[ the existence and uniqueness as well as the inequality 
( 15.201) can be obtained directly. It remains to prove the nonnegativity of K. For any given 
(t, x) G [0,T] x R n , we introduce the following linear SDE: 



d-z 



dy s =A s y s ds + C] l y s dW l s l + £ CfjfcdW; 



2j 
s 



i=l 



i=l 



+ / E s (9)y s ^fi(d9,ds), y t = x, t^s^T. 



(5.22) 



From Lemma 12.11 SDE (15.221) has a unique strong solution y. Applying Ito's formula to 
(K s y s ,y s ) we have 

di 



d(K s y s , Vs) = -{QsVs, Vs)ds + Y,(V*, CL l : + K s C l ; + C l s l * K s )y s )dW^ 

i=l 

+ / (y a _, (# a (0) + K a -E,(6) + K{9)k s - + H s (6)E s (6))y s _}jl(d6, ds) 
Jz 

+ / (y^,E:(d)(HM + K S -EM + H s (e)E s (e))y s -)KdO,ds), 
Jz 

Thus, taking conditional expectation, we get 



(5.23) 



(K t x, x) = E 



(Q s y s ,y s )ds + (My T ,y T ) 



(5.24) 



Since Q and M are nonnegative a.s.a.e., from (I5.24p . we conclude that K is nonnegative 
a.s.a.e.. □ 



Define the mapping F : [0,T] x (S n ) + x (S n ) dl x C> 2 {Z;S n ) x i? mxri -> S n by 
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F(t, K, L 1 , H, U) =(A t - B t U)*K + K(A t - B t U) + C^L 11 + L U C\ { 

i=l i=\ 

+ Vcf*ifC^ + / H(0)E t {0)u(dO) + / E*{6)H{6)v{d9) 
l=1 Jz Jz 



(5.25) 

+ / E* t {9)KE t {9)v{d9) + / E*{9)H{9)E t {9)v{d9) 



z 

+ £(C* - DfUYK{Cf - DfU). 
1=1 

By notation flBTTSl) . define the mapping £7 : [0,T] x (S n )+ i? mxn by 

U(t,K) = N-\t,K)B*{t,K). 

Lemma 5.5. Let (K, L 1 , H) G (<S n )+ x (<S n ) dl x C u ' 2 (Z;S n ). Then, forVU G i? mxn , we 
have 

F(t, K, L 1 , H, U) + U*N t U ^ F(t, K, L 1 , H, U(t, Kj) + U*(t, K)N t U(t, K), 0<t<T. 

(5.26) 

Proof. By the definition of F(t, K, L 1 , H, U), B(t, K), N(t, K) and U(t, K), it follows that 
F(t, K, L 1 , H, U) + U*N t U = -U*B*(t, K) - B(t, K)U + U*N(t, K)U 



+ A\K + KA t + Cl { *L 11 + ^'C? 

i=l i=X 

+ £c* t *KC} i + J z H(6)E t (6)v(d6) + J z E;(6)H(6)v(d6) (5 _ 2?) 



+ J E* t (6)KE t (6)v(de)+ \ E*(9)H(9)E t (9)p(d9) 
1=1 



and 

F{t, K, L\ H, U(t, Kj) + U*(t, K)N t U[t, K) = -U*(t, K)N(t, K)U{t, K) 



+ A* t K + KA t + C l { * Lli + hUC ^ 
i=i i=i 

+ J2 C u* KC u + I H (9)E t (9)u(d9)+ I E;(9)H(9)u(d9^ 2S) 



i=i 

+ J E* t {9)KE t {9)v{d9) + I E* t {9)H{9)E t {9)v{d9) 



i=l 
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Therefore, 

F(t, K, L\ H, U) + U*N t U - F(K, L 1 , H, U(t, K)) - U*(t, K)N t U(t, K) 
= -U*B*(t, K) - B(t, K)U + U*N(t, K)U + U*(t, K)N(t, K)U(t, K) 
= -U*N(t, K)U(t, K) - U*(t, K)N t U + U*N(t, K)U + U*(t, K)N t U(t, K) 
= {U{t, K) - U)*N(t, K)(U(t, K)-U)> 0. 

The proof is complete. 



(5.29) 



□ 



In the following we will use the Bellmans principle of quasi-linearization and a mono- 
tone convergence result of symmetric matrices (see [20]) to show Theoren J5.3l 

Existence By the definition of F(t, K, L 1 , H,U), BSRDEJ (I5.17P can be rewritten as 
the following quasi-linearization BSDE 



-dK f 



Fit, K t , L], H t , U(t, K t )) + U*(t, K t )N t U(t, K t ) + Q t 

-S^L^dW} 1 - I H t (9)fl(d9,dt), K T = M. 
i=i Jz 



dt 



(5.30) 



Making use of Eq.f l5.30p . we will iteratively construct a sequence {(Kj, L], Hj)}^ =l oi ap- 
proximating solutions of BSRDEJ (I5.17p . In fact, by Lemma [5.4[ we set (Kq, Lq, Hq) = 
(0, 0, 0) and solve iteratively the following linear BSDE: 



-dK 



F(t, K j+1>t , L) +lp H j+1)t , U(t, K ht )) + U*(t, K j>t )N t U(t, K ht ) + Q t 

-J2L)Xi,tdW t u - / H j+l>t (9)fl(d9,dt), 
i=i Jz 



dt 



M. 



(5-31) 

From Lemma I5.4[ it follows that Kj IS cL.G.cL. s. bounded and nonnegative. We also 
claim that {Kj + i} is a.e.a.s. a non- increasing sequence. Indeed, 
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- d(K j)t - K j+1)t ) = (-dK j)t ) - (-dK j+1>t ) 
F(t, K jtt , Ll t , H j>h U(t, Kj^ t )) + U*(t, Kj-x^Nt&it, K^ t )) 

-F(t,K j+1 H j+ltt , U{t, K jtt )) - U*(t, K jjt )N t U(t, K jtt ) dt 

- - Lf^dW^ - [ {H ht {6) - H j+1 M)KdO, dt) 
i=i Jz 

F(t, K jtU L) p H j>t , U(t, K j>t )) - F(K j+1>t , L) +lp H j+1 , t , U(t, K j>t )) 
+ \F(t, K jtt , L) >t , H hU U(t, Kj^ t )) + U*(t, Kj^ t )N t U(t, K^)) 



F{t, K j)t , L j>t , Hj it , U(t, K jtt )) - U\t, K j>t )N t U{t, K. 



j,t, 



dt 



i=l 



- - L]\ ht )dW t u - l_(H j>t (6) - H j+1 , t (9))KdO, dt) 



F{t, Kj,t ~~ Kj+i,ti Lj t — Lj + i )t , Hj t — Hj + ij, U (t, Kj t t)) 



dt 



(5.32) 



+ {U{t, K jtt ) - U{t, K^ lit ))*N{t, K j>t ){U{t, K jtt ) - U{t, K^ t )) 

- J2(L% - L)^ t )dW t u - / (Hl t (6) - H} +1 j(9))jl(de, dt), 

where we have used the equality (I5.29P in Lemma [5.51 

Since (U(t, K jtt ) - U(t, Kj_ u ))*N{t, K j>t )(U(t, K jjt ) - U(t, K^ t )) is nonnegative, ac- 
cording to Lemma 15.44 we conclude that Kj t — Kj+i t t is also nonnegative. This implies 
{Kj}JL 1 is a non- increasing sequence 

CI > K ljt >K 2it >--->K jtt ^--->0, te [0,T]. 

It follows that {Kj} converges almost surely to a nonnegative bounded, S n - valued process 
K. According to Lebesgue's convergence theorem, we have 



lim E [ \Kj t - K t \ q dt 0, Wq > 0. 



(5.33) 



Thus {Kj}f =1 and {u(t,Kj)}JL l is a Cauchy sequence in the above sense. Again using 
Lebesgue's convergence theorem, for t 6 [0, T], we also have 



lim E\K jt -K t \ q 0, Vg>0. 



(5.34) 
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Zx(0,T] 



2E / tr 



Applying Ito's formula to \K k>t — Kj tt \ 2 , we get 

E\K kfi - K jfi \ 2 + E f \L\i t - Lffdt + E 
i=i Jo 

(K k ,t - K ht ) (c?{L% - Ll) + {Ll t - )C« 

/ E;(9)(H k>t {6)-H j>t {6))is(d6)+ [ (# fc>t (0) - H j>t (6))E t (e)v(d6) 
Jz Jz 

+ [ E* t (6)(H Kt (6) - H ht (6))E t (6)v(d6)dt + R(j,k) 
Jz 

4l> f \ L lt-L^\ 2 dt+\E ff \H kjt {9) - H jjt {B)\ 2 v{dd)dt 

/ ~[ J0 z J JZx(0,T] 



H k , t (6) - H u (6)\ 2 v{d6)dt 



(5.35) 



+ CE [ \K k>t -K jtt \ 2 dt, 
Jo 



where 



R(j, k) =2 jf tr (K ktt - K j>t ) ([[K k)t - K ht )A\ + A* t (K k<t - K j)t 



+ CT*{K k , t - K ht )C 21 + U*(t, K k -x, t )N(t, K k>t )U(t, K k ^ t ) 

i=l 

- U*{t,K _ u )N{t,K ht )U{t,K _ u ) - U*(t,K k _ u )B*(t,K ktt ) 

- B(t, K ktt )U(t, K k _ 1)t ) + U*(t, K^ 1>t )B*(t, K ht ) + B(t, K j)t )U(t, K^ t ) 



(5.36) 



dt 



and C is some deterministic positive constant. 

Thus from (I5.33P and (I5.34p . we know that {Lj}°5 =1 and {Hj} ! ^ =1 is Cauchy sequences 
in £^((0,T; (S n ) dl ) and ££*([0,T] x Z; S n ) respectively. We denote the limits by L 1 
and H respectively. In the end, passing the limit in Eq. fl5.31fl . we obtain that (K, L 1 , H) 
satisfies Eq. (l530l) . Thus (K,L\H) is the solution of BSRDEJ (I5TT7D . 

Uniqueness 

Suppose that BSRDEJ (15.171) has two solutions {K,L X ,H) and (K,L l ,H) . Then it 
follows from (I5.30j) that 



-dK* 



and 



-dK t 



F{t, K t , L\, H t , U(t, K t )) + U*{t, K t )N t U{t, K t ) + Q t 

-S^LfdWl 1 - / H t (9)fi{d6,dt), K T = M 
i=i Jz 

F(t, K t , l\, H t , U(t, K t )) + U*(t, K t )N t U(t, K t ) + Q t 
-VLjW^- / H t (6)fi(d6,dt), K T = M, 



dt 



dt 
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Thus 



d(K t - K t ) = F(t, K t - K t , L\ - L\, H t - H t , U(t, K t )) 



+ F(t, K t , L\, H t , U(t, K t )) + U*(t, K t )N t U(t, K t ) 



Fit, K t , L\, H t , U(t, K t )) - U*(t, K t )N t U(t, K t )) dt 



- J2( L t ~ L l l )dW t u - [ {Hid) ~ H t (6))jl(de, dt) 
i=i Jz 

F(t, K t - K t , L\ - L], H t - H t , U(t, K t )) 



(5.37) 



+ (U(t, K t ) - U(t, K t ))*N(t, K t )(U(t, K t ) - U(t, K t )) dt 



£(4 11 - L\ 



])dW t u - [ (H t (6)-H t (0))fi(d6,dt), 



i=i 



Jz 



K T -K T = 0. 

Since (U(t,K t ) -_U(t, K t ))*N(t, K)(U(t, K t ) - U(t,K t )) is nonnegative, it follows from 
Lemma \5. 41 that K — K is also a.e. a.s. nonnegative. Similarly we can obtain that K — K 
is a.e. a.s. nonnegative. This implies K = K . In the end, from the uniqueness result of 
Lemma [5.4[ we conclude that L 1 = L 1 ,H = H. The uniqueness is proved. 
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